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The purpose of this research uas to examine possible outcomes of develop- 
mental students' critical thinking and motivation to read when the onhne 
learning community, WebCT, was implemented My role, in addition to in - 
srructor, was that of participant-observer. I implemented WebCT tools , such 
as discussion board and chat, over a four-month period into my instruction 
to enhance critical thinking and motivation to read m my Developmental 
Studies in Reading II classroom A mixed-method approach for intervention 
evaluation uas employed, and improvements were noted in both reading 
engagement and critical thinking skills by using these online tools. By in - 
corjwraring this technology into the developmental studies curriculum, ux, 
as developmental education instructors , will be encouraging and supporting 
our students' needs to become independent thinkers and learners 


T 


. he motivation behind conducting 
this research lies within the need to examine further effects of online 
learning for developmental reading students. Tb date, only a few re- 
searchers have conducted studies in which they have investigated devel- 
opmental reading and online learning despite the rapid implementation 
of online learning opportunites in many colleges and universities. This 
dearth of research studies is mainly due to the lack of controlled studies 
in community college developmental education programs. Until studies 
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arc conducted, developmental education programs arc adopting promis- 
ing instruction by other community colleges and universities that have 
found them to be successful (Perin, 2005). Implementation preceding 
research could come at a cosdy price to developmental reading students 
in terms of learning and developmental education as a whole if the 
needed research is not conducted. 

Developmental Education and Distance Education 
The National Association for Developmental Education (NADE) pro- 
vides a current definition of developmental education, a field that has 
dramatically changed over the last 10 years: 

Developmental education is a field of practice and research within high- 
er education with a theoretical foundation in developmental psychology 
and learning theory. '* promotes the cugniUve and affective growth 
of all poatsecondary learners, at all levels of the learning continuum. 
Developmental education is sensitive and responsive to individual dif- 
ferences and special needs among learners. Developmental education 
programs and services commonly address academic preparedness, 
diagnostic assessment and placement, development of general and 
discipline-specific learning strategies, and affective barriers to learning. 
(NADE, 2007, 'Definition of Developmental Education,' p 1) 
Concomitant with this definition, Boylan (2002) suggested that colleges 
should give developmental students a variety’ of course experiences 
and not limit their learning to one mode of delivery. Other researchers 
have expanded this suggestion with the contention that students today 
must have computer knowledge to succeed in college and beyond. Leu, 
Kinzcr, Coiro, and Commack (2004) stressed the importance in our 
global economy of equipping students with “new literacies’ that support 
social communication and use of communication technologies where 
possessing these skills in our world today arc vital. Leu ct al. defined 
new literacies as 

the skills, strategies, and dispositions necessary to successfully use 
and adapt to the rapidly changing information and communication 
technologies and contexts that continuously emeige in our world and 
inlluence all ureas of our personal and professional lives. These new 
literacies allow us to use the Internet and other ICB to identity impor- 
tant questions, locate information, critically evaluate the usefulness of 
that information, synthesize information to answer those questions, 
and then iMtnmunicate the answers to others. (Leu. et al., 2004) 

Hie communicative, social nature of online learning allows students 
to utilize and enhance these important skills. 

According to a 2000-2001 report by the National Center for Education 
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Statistics (NCES, 2003), 13% of all institutions offered developmental 
courses through distance education. The following is a breakdown of 
institutions offering developmental education through distance educa- 
tion: 25% of public 2-year colleges, 8% of public 4-year institutions, and 
4% of private 4-vear institutions. 

Between 1905 and 2000, statistics indicated a substantial increase of 
distance education use in developmental education in all institutions 
(from 3% to 13%). Also, during this time period the proportion of public 
2-ycar colleges offering remedial courses through distance education 
increased from 6% to 25%, and the proportion of public 4-year institu- 
tions increased from 4% to 8%. 

In Fafl 2000, 64% of the institutions overall used Internet courses 
using asynchronous communication as a primary mode of delivery’ for 
remedial instruction. It can safely be assumed that these numbers have 
increased from 2000 until now and will continue this ascending trend. 

Despite the rise in online developmental education, implementation 
lias been a concern for many in developmental education due to ap- 
prehensions relating to (a) attrition rates, (b) prior knowledge to utilize 
effectively the technology, and (c) the independent nature of this ty^ic of 
learning (Petrides, 2006). However; recently researchers have suggested 
that online learning yields student success in a number of areas. Wad- 
sworth (2007), in a study of online developmental mathematics, reported 
that study skills instruction increased student success rates and that the 
autonomy of this particular learning environment supported students' 
motivation to learn. Lee (2007), in a study of online collaborative ease 
study learning, demonstrated that critical thinking skills can be achieved 
through online ease study instruction. The collaborative nature of on- 
line discourse afforded the opportunity to glean varying perspectives 
Osterman’s (2005) comparison of online versus traditional instruction 
in a developmental reading course established that the results were not 
statistically significant between the success and completion for both 
learning environments. Many students in the course gamed enough 
self-confidence in their newfound technology skills that they’ invested in 
computers with the hope of continuing their learning success. Cavcrly 
and Peterson's (2005) look at building literacy through online discus- 
sions forums indicated that online interaction sets the stage for social 
presence, cognitive presence^ and teaching presence, thus building the 
necessary college literacy skills that many developmental education 
students need. Students perceived increased time management skills 
and ability to read text more accurately’ in Krcch's (2001) study with 
online developmental writing students. These important self-regulatory 
skills ultimately afforded them the opportunity to become independent 
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learners in charge of their own learning. Researchers liavc shown that 
self-regulation is vital for developmental education students, as it serves 
as the foundation for support in learning, motivation, and performance 
{Pintrich & Garcia, 1994). 

Characteristics of die Developmental Reading Students 
Students who have been tested into a developmental reading course often 
need study strategics and reading skills necessary to deeply comprehend 
college texts (Elder & Paul, 2004). Not only arc they not prepared for 
the rigors of college text reading, but they arc also ill-prepared for other 
life challenges that require skills in reading. Researchers noted that un- 
derprepared students who successfully pass a developmental reading 
course 'experience significantly greater success in college over the long 
term compared to similarly underprepared students who either do not 
take, or do not pass, such a course* (Cox, Friesner, & Khayum, 2003, 
p. 189). Developmental reading students who were explicitly taught 
reading strategics showed more academic success than those who did 
not receive explicit instruction. Students were also able to transfer the 
skills learned to college courses requiring intensive reading (Caveriy, 
Nicholson, £< Raddifle, 2004). 

Currently, there arc estimates that "40% of tiret-amc students enter- 
ing the average community colleges arc underprepared for college-level 
work* (National Center for Educational StatisDes, 2003). Figure 1 shows 
the demographics of developmental education students: 

education demographic pi o files typically include gender, ethnicity, 
enrollment status, age. level of deficiency, commuter stilus, and so- 
cioeconomic status. 

Women make up over half of all developmental students, and the 
overall average age of developmental education students is 24 (Saxon 
& Boyian, 2004). 

It is also clearly evident, according to this figure, that poverty is a 
significant characteristic, and researchers have shown *a strong cor- 
relation be ween poverty and academic under-preparedness" (Lavui 
& Hyliegard, 1996; McCabe & Day, 1998). According to the Tfcxas State 
Data Center and Office of the State Demographer Web site, it is projected 
that by 2010, His panics will be the fastest growing population needing 
these courses. 
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Figure 1 Demographic characteristics of community college 
developmental students 


Students 

Gender 


Ft male 

55% 


Male 

45% 


Avenge age 

24 


met 

White 

67% 


African American 

23% 


Hispanic 

6% 


Asian 

3% 


American Indian 

1% 


Married 

25% 


Income Lean dun $20,000 

54% 



Note The data in the column arc from the National Center for 
Educational Statistic* 1996. Adapted with permission. 

Motivation and Critical Thinking Skills of 
Developmental Reading Students and Online Learning 
In what ways can online learning facilitate engagement? In Hippo’s 
(2001 ) study of research conducted by reading experts, it was found that 
access to reading materials, opportunities for self-selection, and social 
interactions about text were all important in fostering reading engage- 
ment. Gambrcll (2006) suggested that technology can develop these 
characteristics. Despite research yielding comparable motivation levels 
of developmental education students to that of regularly-admitted college 
students (Ley Sr Young, 1 998), in the specific area of developmental read- 
ing, the lack of motivation to read is a common issue and students need 
to be encouraged to acknowledge the value of their education to change 
this behavioral pattern {Try Sr Ecung, 1998). In Moore's (2007) research 
on academic motivation and performance of developmental education 
biology students, lack of motivation was attributed to lack of academic 
skills and related experiences of traditional students. He further asserted 
that student choice in completing academic tasks directly related to 
motivation and, therefor* ‘any means that increase at-risk students’ 
motivation and engagement should be pursued - (p. 32). Furthermore, 
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Lijwcry and Young (1992) suggested that developmental educators should 
provide students with instruction that is interesting and that will serve 
as a catalyst for self-directed learning. Both stimulating learner interest 
and offering instructional options arc motivational strategies that arc 
suggested and encouraged in developmental education. 

Using distance education tools, such as discussion board and chat, 
has been shown to stimulate learner interest, thereby increasing 
motivation to learn. Specifically, interest has been demonstrated in 
online environments that arc interactive— where students actively 
engage with others, hence refining, adding or creating new knowledge 
(Uccghly, 2005; Johnston, Killion, frOmomcn, 2005, Pallof & Pratt, 2003). 
When students arc actively involved, they arc able to understand and 
apply what they have learned m real world situations (Eblc, 1988). This 
understanding and application ultimately provides authentic reasons for 
learning, thereby creating student motivation and excitement to learn 
(Quitadamo & Brown, 2001). Mien students arc interested in a topic 
or situation, they arc likely to ‘process information in a meaningful, 
organized, and claborativc fashion— for instance, by relating it to things 
they already know, interrelating ideas, drawing inferences, forming 
visual images, generating their own examples, and identifying potential 
applications* (Hidi & Anderson, 1992, p.23). 

Online learning also has been demonstrated to promote critical think- 
ing skills— which arc also cited as important skills that developmental 
readers need (Lee, 2007). Scrivcn and Paul (2004) defined critical think- 
ing as analysis, synthesis, and application of learned information to 
various situations. Lee (2007) posited, ‘The ability to think critically is 
needed in this revolutionary age of technology change. Among the es- 
sential skills required to close the gap between the knowledge and skills 
students learn in schools and those required to function effectively in 
the workplace and community is the ability to think critically (p. 82). 

When students arc asked to apply and reflect on what they learn, they 
retain more content (Bcrcitcr & Scardamalia, 1989). Smith, Ferguson, 
and Cans (2001) asserted that contrary to intuition, current Web-based 
online college courses arc not an alienating, mass-produced product. 
They arc 3 labor-intensive, highly text-based, intellectually challenging 
forum which elicits deeper thinking on the pan of the students and which 
presents, for better or worse, more equality between instructor and 
student Initial feelings of anonymity notwithstanding, over the course 
of the semester; one-to-one relationships may be emphasized more in 
online classes than in more traditional face-to-face settings (p. 4). 
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Course Design and WebCT Tbol Description 
Good practice. For this research, 1 have drawn support for the course 
design from the Seven Principles for Good Practice in Tfcaching and 
Ifcchnology (Ibsta, 2000). These principles emphasize student-faculty 
contact, student-student collaboration, active learning, prompt feedback, 
time on task, high expectations, and respect for diverse talents. The 
underlying presupposition guiding these principles is that by incorpo- 
rating these into instruction, learning will occur (Frcdcrickson, Pickett, 
& Shea, 2000). 

By using WebCT discussion board and chat tools coupled with proper 
guidance and instructional direction, students arc able to contemplate 
aillabo natively and critically analyze course material and discussion 
topics This higher-level learning, in turn, leads to active and interactive 
learning, which is an important component in the learning process. 

Tb lay the foundation for the desired results of this research, it was 
necessary to design instruction incorporating both WcbCr discussion 
board and chat sessions throughout much of the semester in addition 
to regularly-held traditional classes. 

The course was taught using a hybrid online model. The hybrid online 
model gives flexibility with classes and m creases interaction and contact 
among students (Gamham S' Kalcta, 2002). This model illustrates the 
learner-centered nature of a hybrid class and serves as a solid foundation 
for introducing developmental students to online learning. See Figure 2 
below to view the dynamic nature of faculty-student interaction as well 
as student-student interaction. 

Figure 2. 77ie hybrid online model. 
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I dc-adcd tn use the backward design approach described by Wiggins 
and MeTighe (2005 ). This curriculum design encourages the mstniclnr 
to plan a course from the end to the beginning It is effective in yielding 
specific results and can be utilized to plan a lesson, a study unit, or an 
entire course (Wiggins & MeTighe, 2005). By following the backwaid 
design approach, 1 was able to design my course with the end result in 
mind: having my students motivated to read and having all or most of 
my students being able to understand and critically think about what 
they read. 

Designs, management, and strategics in synchronous and asynchro- 
nous learning arc good indicators of online learning success (T\i, 2003). 
If the design of an online course is easy for the student to navigate and 
implements clear; well-defined objectives for learning, students tend 
to feel comfortable with this mode of learning. Whereas chat sessions 
create a means for electronic communication (Martyn, 2003), the qual- 
ity of chat interaction depends heavily upon the instructional delivery 
(Roberson & Klotz, 2001). Hence* by kcepmg chat sessions small in size 
(four to five students), I was able to monitor my students' engagement 
in inductive reasoning and understanding. 

Discussion board. Discussion board provided an asynchronous com- 
municative forum where students could work collaborativcly and share 
thoughts and ideas. In traditional classrooms, time constraints and di- 
vided attentions sometimes prohibit in-depth discussions. By using the 
discussion board tool, students benefit in many ways. They have (a) 
4 think time 4 before responding, (b) the opportunity to respond thought- 
fiilly without interruptions, (c) opportunities to read other classmates' 
responses and think about them before responding, and (d) opportunities 
to converse without limits with fellow classmates (Lindsey-North, 2000, 
p 4). Students have the ability to think and reflect on what they post to 
the discussion board, thereby increasing the quality of discussion. 

ChaL The chat tool on WcbCT is delivered synchronously, allowing 
students and teacher to discuss, converse, and share ideas. According 
to D'Eca (2003), different types of interactions arc evident in chat ses- 
sions: (a) student-to-student (generates sharing of personal experiences, 
viewpoints, etc.), (b) student- to-tcachcr (allows for individual or group 
help), and (c) snide nt-to-onlin c-rcsourcc ( encourages timely analysis and 
discussion of materials online). Other advantages m eluded exercising 
communication skills and etiquette, express mg ideas and receiving im- 
mediate feedback, developing personal (independence and autonomy) 
and interpersonal skills (helping, discussing, debating, suggesting), and 
establishing time management skills (arriving to session on time). Both 
discussion and chat also encouraged students who arc were typically 
shy in the traditional classroom to actively participate. 
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Disadvantages of Chat and Discussion Board Tools 
Some of the documented issues with discussion board and chat include 
(a) organizing chat times around busy schedules; (b) Internet access at 
home; (c) previous exposure and use of computers; (d) computer glitches 
(i.c. t DSL, dial-up); and (c) cost (as more and more institutions use 
hybrid courses, there will be pressure to develop more computer labs) 
(D'Eca, 2003). College students lead busy lives with many working full 
or part-time jobs; therefore, trying to organize chat sessions around these 
schedules can be cumbersome. Some students may not have Internet 
access or be able to afford Internet access. However; many campuses 
today offer Internet-ready computer labs or free wireless connection 
for laptop computers. Also, by offering pre-course orientation, many 
of these issues can be addressed before the inception of class, thereby 
eliminating much of the frustration associated with computer-use. 


Identifying Engagement and Critical Thinking When 
Using Discussion Board and Chat Tools 
Engagement. It is well established in research that a well designed on- 
line learning community creates a strong sense of community among 
students (Hassclbring, Lott, & Zydney, 2004). As an online instructor, 
it is necessary to ensure that learning is actually occurring in an on- 
line learning community. In that respect, it is important to define the 
depth of learning students will glean when using the discussion board 
and chat tools by identifying and measuring student engagement. This 
measurement can be achieved by examining levels of participation, 
student perceptions, and completion of assigned tasks. 

Critical thinking. Conrad and Donaldson assert that "evaluation of 
critical thinking and reflection requires assessment methods that encour- 
age individual expression* (p. 25). This evaluation was accomplished by 
assessing responses in chat sessions and on the discussion board with 
Perkins and Morphy's (2006') Model for identifying engagement in critical 
drinking. This model serves to identity indicators in four different cat- 
egories- clarification, assessment, inference, and strategies that can be 
used by developmental reading instructors to measure critical thinking 
in the context of online discussions and chats. See Thblc 1 below. 

With disaission board and chat, depth of understanding can be assessed 
by monitoring the conversations and recording key words or phrases 
indicative of higher-order thinking within these four categories. 
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Table 1 Model for Identifying Engagement in Critical Thinking 

Cliiriiituitiiin 

All aspects oi* muting, darifying, d«mxiblng (but not explaining ), or defining 
the issue being discussed. 


Prnpicc* an 
iftsue far drbore 


Analyzes, 


i or 


discusses the 
meaning at the 

UUUC. 


underlying 
auumpeen* m 


Identifies 

reLitxinihqis 



Defines nr enti- 
n yrt the defini- 
tion of relevant 



Auttiment 

Evaluating some aspect of die debate, making judgment# on a situation, 
proposing evidence for an argument or for links with other taues. 


Provides or aika Provides or 
far reasons that asks foe reasons 
proffered eri- that proffered 
de nr r is valid. evidence is 
relevant. 



Gives evidence 
far choice of 
asaeiament 
criteria. 


Showing connections among ideas, drawing appropriate condustons by 
deduction or induction, generalizing, explaining (but not describing), and 
hypothesizing. 


Mokes appropri- 
ate deductions. 

Make* appro pn 
ate inference* 

Amrci at a 
conclusion. 

Make* general 
nations 

Deduce* 
rcLitimshipi 
among idea* 

Strategies 

Proposing, discussing, or evaluating possible actio ns. 

Ihkci action. 

Describes pos- 
sible. *ctx>ns. 

Evaluates poo* 
sshle actions. 

Predict* note 
cornea of pro- 
posed actions 



Eased upon the literature review, supplementing the discussion board 
and chat with instruction has the potential to increase engagement and 
critical thinking skills for developmental reading students. The design 
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and development of the course is crucial and must have catalytic com- 
ponents which spark active learning. Online learning holds promise 
as a strong influence in developmental education in both reading and 
writing success, and may effectively prepare developmental reading 
students for college-level courses and thereafter. 

Research Question 

The following research question guided this study: Can chat and discus- 
sion board foster engagement and critical thinking among developmental 
reading students? 

Method 

Participants 

Participants involved in this study include one section of Developmental 
Reading at a community college in Southeast Tbxas during the spring 
2007 academic semester There were initially 20 students total: 12 males 
and 8 females. However; 2 males dropped the course, leaving the total 
at 18. There were no ESL or Learning Disability students in the class 
Traditional class time was held on Mondays and computer lab time to 
work with WcbCT tools was held on Wednesdays. The division of time 
provided a balance where students could gradually get their feet wet with 
the online learning tools without feeling pressure to jump right in. 

Design and Procedure 

Both qualitative and quantitative methods were used to categorize the 
research. The crux of the quantitative data included transcripts from 
both WebCT chat and discussion board tools. The Murphy and Perkins 
(2006) model was used to measure critical thinking and engagement by 
analyses of data from the discussion board and chat transcripts and by 
the number of discussion posts, respectively. Critical thinking was also 
measured using pro and posttest scores taken before using discussion 
board and chat and after using discussion board and chat. Inter-rater 
re Lability was utilized by recruiting three developmental reading evalu- 
ators to assess discussion board posts, pre-discussion board test scores 
and post-discussion board test scores. These 'calibration sessions* were 
regularly held meetings among the developmental reading instructors 
to ensure consistent scoring procedures. Qualitatively, observations 
were recorded in weekly journals and were interwoven with interviews, 
which provided thorough information about the data. It also served to 
otiss-referencc the data compiled in observations. Formal and structured 
interviews were audio recorded, conducted individually, and then later 
transcribed. The survey at the end of the activities included questions 
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reflecting student satisfaction and perceived learning using WcbCT 
tools Names of those persons involved in the research were changed 
to protect confidentiality. 

A preliminary questionnaire was given at the beginning of the course. 
By using a questionnaire, 1 was able to collect large amounts of data 
within the time constraints of a semester The questionnaire indicated 
that all of my students had a computer at home with Internet capabili- 
ties; however, none of my students had previous experience working 
with WcbCT and most were unsure of its purpose and structure: Angie 
(student) said, i’m not sure yet but I will give it a tiy! It would be a 
great thing for me personally because 1 get bored easily, so 1 like stuff 
that 1 have to figure oud* 

Course preparations and adjustments. Before beginning the re- 
search, I was aw'arc that the motivation to read and a lack of critical 
thinking w ? crc underlying issues with some of my developmental stu- 
dents. TOiis awareness prompted the decision to supplement WcbCT 
into my classroom- Having taken online courses myself and having a 
pleasant learning experience while doing so, I felt the need to see if 
1 could provide a learning experience for my developmental students 
that equaled or even surpassed wiiat I had experienced— both in learn- 
ing and enjoyment. 1 wove activities into my course design in such a 
way that both critical thinking skills and motivation would be encour- 
aged and evidenced. By trying chat and discussion board with previous 
semester's students and experiencing some of the Irinka,* 1 was able to 
make adjustments and enhancements and proceed with the research 
with the following semester’s students. One of the issues I encoun- 
tered the previous semester w r as conducting chat sessions outside of 
classroom time. For the research group, I decided to hold chat sessions 
in the computer lab instead of having the students “meeting* with me 
outside of class. Students* scheduling conflicts with work and families 
caused me to change this aspect of chat and by doing so, a few of the 
problems were eliminated. 

Alter the course was designed to my satisfaction and for the purpose of 
this study, l divided my students into four groups of five for both discus- 
sion board and chat session activities. I decided to use the same groups 
for both ease, consistency, and to strengthen student interaction. 

Orientation and follow-up. Before engaging in any of the WcbCT 
activities, 1 devoted an entire class period to introducing WcbCT and its 
various components. 1 inserted a "welcome to class* video that outlined 
a description of the entire course, course objectives, and requirements 
as well as readings and materials. We visited the chat room, the discus- 
sion board, and 1 also showed them our Intranet email. They were fas- 
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cinatcd by knowing that they could accc&s their grades under the tool 
4 My Grades* at any time to keep track of their progress. By installing 
an assignment section where each daily assignment could be posted, 
students could keep informed if they happened to be absent on a certain 
day. By the end of class, everyone had successfully navigated the course, 
and 1 felt confident that they were comfortable using it 
I also adhered to course management tips to ensure the experience 
was positive for my students. I made certain to do the following on an 
ongoing, regular basis: 

1 . tagging onto the course everyday. 

2. Checking and immediately responding to student email 
several times a day. 

3. Grading and returning assignments, quizzes, and tests as 
quickly as possible. 

4. Checking with each student periodically via WcbCT to an- 
swer any questions and to sec if he or she had any concerns 
about cither the traditional class portion or the WcbCT por- 
tion. 


Data Analysis 

Chat quiz scores (data # 1 ). Before entering a chat session, students 
were required to read an assigned essay each week from one of our 
texts. Essays from Contemporary Culture by Ackley (2001). Among the 
four chat sessions, this research specifically focused on the essay, ‘Mak- 
ing the Grade/ written by Wiese nfcld. The students prepared for chat 
sessions by (a) reading the text and (b) taking an online quiz on the 
reading. Each online quiz was worth 20 points and accounted for 20% 
of their overall grade. Thus, after the course overview at the beginning 
of the semester, students understood that the quizzes comprised a good 
portion of their grade. These preliminary activities encouraged students 
to read the material in order to perform well on the quiz and then be 
prepared for thoughtful discussion. 

Discussion board post scores (data #2). The discussion board pro- 
vided space where writing skills were also used and where there was 
potential for further research. For discussion board activities, each group 
was assigned a weekly reading from Essays from Contemporary Culture 
over the course of four weeks (four rcadings/discu&sions per week). 
Different questions were posed to each group to answer and discuss 
and came from the ‘Reader Response* section of the essay, which 
represented questioning levels conducive to critical thought Among 
four discussion board readings, the short story ‘Silence* by Watson was 
used for this research. There were two requirements for this reading 
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assignment: (a) that the student write a well-developed posting to the 
original question and (b) that the student write two insightful responses 
to two other classmates' responses in any of the other three groups. This 
expanded opportunities to respond to other groups as well as encour- 
aged the reading of most or all of the other discussions. 1 also chose not 
to participate in these discussions as 1 did not wish to squelch student 
interaction. 

Journal entries (data *3). During the chat sessions, personal thoughts, 
reactions, concerns, or ways to improve chat w ? crc noted. 

Student interviews (data *4). Interviews w r crc conducted in order to 
speak individually with students to learn specifically what they liked 
or disliked about discussion board and chat and if they perceived that 
they were learning. 

Student survey (data *5). Students responded to survey questions 
that addressed their satisfaction and perceived learning using discussion 
board and chat at the end of the semester using a Likert scale of 1-5 (1 
= strongly disagrcc > 5 = strongly agree). 

Chat and discussion board transcripts (data *6). A feature of Wc- 
bCT chat and discussion board tools is that discourse is automatically 
recorded. An instructor may go back and analyze a chat transcript or 
discussion board post for a number of instructional purposes. Discussion 
board and chat transcripts were analyzed using the Perkins and Murphy 
(2006) model for identifying engagement in critical thinking. 

Pre- and posttest scores (data *7). One of the primary research objec- 
tives was to see if students were able to master effectively a test similar 
to the District Common Final (DCF), which is a final exam administered 
to all of the Developmental Reading classrooms within this particular 
college district. The final is a large determinant of whether the student 
passes or fails the course. The DCF consists of a reading passage and 
multiple-choice and short-answer questions, which require critical read- 
ing. Students must demonstrate critical thinking skills in their answers 
as u T cll as to be able to identify various literary elements such as tone, 
pattern, mood, and intended audience. 


Results 

Chat quiz (data * 1 ). The distribution of chat quiz grades was as follows: 
8 students made an A, 4 students made a B, 4 students earned a C, and 
2 students earned a D. As 80% of my students passed the online quiz, 
it may be interpreted that these students had an understanding of the 
reading material. 


Usang Weber ua a supplemental fcitif 


23 


Thblc 2 Quiz Grades for * Making the Grade 0 Online Quiz 


Number uf Students 

Quiz Grade (out of 20 points) 

Grade Percentage 

2 

120 

60% 

4 

14 0 

70% 

4 

16.0 

80% 

6 

18.0 

90% 

2 

20 0 

100% 


Discussion board post scores (data *2). The scores from the discus- 
sion board posts provided confirmation that most of my students were 
able to use many of the critical reading skills from the Perkins and Mur- 
phy model. The distribution of final grades was as follows: 11 students 
earned an A, 5 students eamod a B, and 2 students earned a C. 

Thblc 3 Scores From * Making the Grade 0 Discussion Posts and 


Number of 
Students 

Grade 

Received 

Grade Range 

Letter Grade 
Equivalent 

8 

25 

20-25 

A 

3 

20 

20-25 

A 

5 

2 

19 

13 

14-19 

8-13 

B 

G 


Journal entries (data #3). From this data, I (a) observed my students' 
reactions to chat and (b) recorded any indicators of active engagement 
What 1 learned from journal entnes supported both my goals: 

February 6, 2007, Journal Entry 

Wow, lots of grading lately , but have finally put Weber dbemaion board 
and chat to work. The students love it. I’ve seen mure positive reaction 
coming from chat over discussion board, but overall the students like 
iL (Burgess, 2006) 

Student interviews (data *4). Consider the following questions and 
comments from the interview with one of my students: 

Melissa (M.): Do you feel that WcbCT has improved the learning 
community within our classroom? 

Brittany (B*)x Yes. When 1 get on the discussion board and answer 
the questions you put on and someone else responds with a comment 
or says something different than what 1 say, it helps me to get to know 
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them better. I don't talk much in class so 1 do better by typing it on the 
computer. 

M.t When 1 post discussion questions to WcbCT for discussion, do you 
read the assignment or essay before posting? Why or why not? 

B.: I do read the essays before putting a post on WebCT because 1 
won't know what to say unless I read the assignment 

M.t On the WcbCT Discussion Board, do you read other classmates' 
postings to discussion questions as the assignment asks? 

B.: Yes, because 1 am curious to know what they said too. Sometimes 
1 see something that 1 can relate to and post something back to that 
person. 

M.t Do you feel that your motivation to post your responses is high 
or low, knowing it will be posted for all to see? Please explain. 

B.: Well, when I know that everyone in class might be reading what 1 
wTitc, it makes me write better 1 also want to make sure that I understand 
the assignment, so 1 make sure I can understand what 1 read too. 

M.t About how many postings do you read? 

B.: I actually try to read all of them— 1 like to see what other people 
wrote. 

M.t We also use the chat tool to discuss the essays w'c have read. Do 
you like this tool? Why or why not? 

B.: I love getting on chat. At first I'm nervous because I know that I 
could be asked something that I don’t know* the answer to, but after a few’ 
minutes 1 get comfortable and what I read comes back to me. Sometimes 
other people ask the same question I was going to ask 

M.t Do you prepare for the chat session by reading the essay before- 
hand? Why? 

B.: Yes, just like for discussion board. Like I said before with discus- 
sion board, I want to know what I’m talking about 

M.t When w ? c chat as a group, do you feel you arc learning? Spccifi- 
cally, do you feel that you comprehend the essay more by discussing it 
via this format? Why or why not? 

B .2 Yes, 1 feel 1 am learning because I also learn from other people in 
my group. They may say something about the essay that I hadn't thought 
of before. 1 seem to understand more because 1 ask more questions with 
chat tlian I do in the classroom. 

Not only is there perceived learning shown in this interview, but 
there is motivation to know’ more and to read more through piqued 
curiosity at 4 what other people wrote.* The collaborative nature ofbotli 
the WcbCT chat and discussion board tools fosters the social aspect of 
learning, thereby increasing the opportunity to build new’ knowledge 
from others or add to preexisting knowledge. 
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Survey ( data »5). All 1 8 participants in this study completed the sur- 
vey. Thblc ‘1 shows the averages of the Likert scale responses. 

Ihble 4 Sun<ey of Students' Perceptions of WebCT Discussion Board 
and Chat Tbols 


Survey of students' perception uf 'WebCT discussion board 

and chat tools Average* 


Participation increased scores on practice testa, tests, and 
qutxx&s 

Participation increased total course point* 

Purticiputiun increased understanding (if content 
Participation increased reading comprehension 
Participation increased motivation to mad 
Participation increased understanding of technical as- 
pocta 

Participation increased interaction with instructor 
Participation increased feeling of community 
I enjoyed participation in online chat sessions 
1 enjoyed participation on the diacusslon board 
Chat attt&lona should be used again for this course 
Diflcuaaion board should be used again for tliia course 


4.2 

4.0 

4.0 

3.8 

4.0 

4.3 

4.1 
3J 

4.4 
4.B 
4.3 
4.0 


•Satie 1- Strongly Disagree . 2- Disagree. 3 -Unsure. 4- Agree 5 -Strongly 
Agree. 


Tlic results from this survey reflect 100% response rate and also in- 
cluded comments such as *At first the WebCT was a small concern for 
me But then as time went on 1 [became) fairly good with it Now it's a 
lot of fun, especially checking out grades assignments, and chatting with 
others''; and 4 1 enjoy chat. It’s cool! 1 like when we interact with each 
other; and talk. It's another side of the teacher; than just [lecturing].* 
Chat and discussion board transcripts (data #6). In the chat session 
covering the reading * Making the Grade/ critical thinking was measured 
in the ongoing discourse with my students. 1 required that the student 
attend the chat session, come well equipped with questions and insight- 
ful thoughts about the story, and respect others' opinions and thoughts 
1 was pleasantly surprised that my students went above and beyond in 
chat sessions by asking each other probing questions, analyzing actions 
by the characters, and being able to identify key literary elements of 
the reading: 
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M.i What docs Wiescnfeld think about those students who ask for a 
higher grade (without really earning it)? 

Betty (B.)x They don’t deserve to have a higher grade if they didn’t 
put any effort into [sic) class. 

Mi That's right. 

Susan (S.)x [T|hat they arc just asking for a grade when they do not 
try. 

Nathan (N.)i He thinks that it's sad that hard work is overruled by 
the sadness of a student 

(M.)s I don’t just hand out grades: 1 try to be fair, but at the same 
time, 1 want you to work for your grade. 1 am essentially holding you 
accountable for your own decisions. 

(M.)t According to Wiescnfeld, who is to blame for this 'erosion?* 
Parents? Tfcachc re? 

(N.)x Tfcachcre. 

(B.)x 1 think it’s the students that arc to blame. 

(N.)x _.to tell you the truth, it should be both. 

The chat session demonstrated comprehension of the story through 
discourse rich in inquiry and understanding of content as measured by 
the Perkins and Murphy (2006) model. Connections were made and 
students demonstrated mctacognibon by sharing their own beliefs about 
students asking professors for higher grades without deserving them. 

Discussion board transcripts also elicited engagement and critical 
thinking. Tb measure critical thinking, 1 looked for evidence in any of 
the four categories of Perkins and Murphy’s (2006) model for engage- 
ment in critical thinking of making connections to previous or current 
content or to real-life situations. 1 wanted to see rich and fuDy developed 
new ideas, connections, or applications. These higher-order thinking 
skills coupled with collaborative learning enhanced and supported the 
learning process. Although I saw* many instances of critical thinking 
in other groups, I decided to use portions of Group 2’s initial posts and 
responses for support. 1 saw several connections to real-life situations: 

Thblc S presents a summary of the critical thinking engagement shown 
through the discussion board and chat transcripts using the Perkins and 
Murphy (2006) model for identifying engagement in critical thinking. 
Participants* engagement is shown by the total number of both discus- 
sion board and chat messages. 

Descriptive statistics indicated total number of messages (M = 7.94, 
SD ■ 1.8 6) and total number of coded units (M =* 6.89, 3D ® 1.94). 
Clarification (M - 3.10, 3D = 1 .34) and inference (M - 2.76, 3D « l .09) 
reported higher responses reflecting critical thinking. Both assessments 
(M « 1.76, 3D * .75) and strategies (M » .71, 3D = .59) reported lower 
responses reflecting critical thinking. 


Table 5 Numerical Summary of Participant*' E 
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Tibia 6 Pre-Discussion Board Test Scores vs. Post-Discussion Board 
1 1st Scores 

Pre-Discuasion Board Post- Discussion Board 
Tfeat Score Test Some 


Student 

(out of 100 ) 

(out of 100 ) 

Student *1 

75 

82 

Student *2 

78 

80 

Student *3 

83 

85 

Student *4 

71 

83 

Student *5 

90 

95 

Student '6 

88 

89 

Student *7 

96 

98 

Student *8 

85 

83 

Student *9 

89 

92 

Student *10 

66 

69 

Student'll 

79 

84 

Student *12 

91 

93 

Student *13 

56 

60 

Student *14 

88 

90 

Student *15 

73 

74 

Student *16 

80 

83 

Student *17 

77 

85 

Student *1 fl 

79 

81 


Student 18 demonstrated seven units coded for clarification. Clarifi- 
cation is evidenced in her statement, *You know when you arc about 
to do something wrong and you know that you arc going to get into 
trouble for it, but sometimes it is worth it?* Student 18 also engages in 
inference when responding to student 4 and further deduces that 'even 
if the mother disapproved of it, the father knew he was going to get 
caught and he didn't even run from the police. He just wanted his son 
to spend the night* Student 15 uses strategies when she predicts why 
the little boy decides to never speak again. *Thc boy probably won't 
ever talk again since he cannot forgive his father for kidnapping him. 
He wants him to know he's mad at him.* Student 3's summation on why 
the father was sent to Jail states *thc father did the wrong thing and for 
that he should be punished for kidnapping a child.* This summation 
reflects the inference category. 

Pre- and posttest scores (data #7). An examination of the histogram 
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pertaining to the pretest scores indicated no serious departure from 
normality. Specifically, the standardized skewness coefficient and stan- 
daidizcd kurtosis coefficients were -1.25 (i.c., -7.25/. 54) and 174 (Lc., 
-.93/ .54), respccnvcly. Similarly, for posttest scores, the standardized 
skewness coefficient and standardized kurtosis coefficients were -.70 
(Le. f - 73/1.04) and 1.39 (i.c. r 1.44/1.04), respectively. Because these 
coefficients fell within the +_ limits (Onwucgbuzic Sr Daniel, 2002), a 
parametric f-test was conducted. 

The dependent samples f-test revealed a statistically significant differ- 
ence between the pretest and posttest scores, f(18) ■ -1.67, p < .0001. 
Tins difference represents an effect size of .53. Using Cohen’s (1988) 
criteria, this difference representsa moderate effect size. Tbblc 7 presents 
the means and standard deviations for both pretest and posttest. 


Thblc 7 Means and Standard Deviations for Pre-Discussion Board Tfcsf 
•Scores and Post-Discussion Board Test Scores 



n 

M 

SD 


Pretest Scores 

18 

80.22 

9.88 


Fustiest Scores 

18 

83.67 

9.25 



Conclusions and Further Research 

Tins research presented anecdotal evidence that WebCT tools, chat, 
and discussion board aid in students' critical thinking skills and reading 
engagement Motivation to use the chat tool sparked a willingness to 
know more and to read more. It is likely that motivation and learning arc 
‘mutually causal— those who arc more motivated to learn learn more, 
and those who learn more become more motivated' (Richmond, 1990). 
It comes as no surprise that online communication methods such as chat 
and discussion board arc so much more than electronic communica- 
tions. They liavc the potential to be a key means to increase motivation, 
thereby increasing the desire to learn and to think critically. 

Continued research in online developmental learning is important 
for students and instructors alike. Online learning communities such as 
WebCT and Blackboard offer an array of tools tliat could promote literacy 
skills (both reading and writing) that developmental reading students 
need (c.g., calendar, blog, wiki). Creating online literature circles via 
chat sessions may also serve as an interesting method or technique. My 
hope is that the research I have conducted will shine a positive light on 
using online learning communities, thereby encouraging more colleges 
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and univcrsiocs to supplement this new literacy. Mien conducting this 
research, I also noted that there were a few students who did not favor 
online learning Further research could analyze and correlate student 
perceptions to personality traits. 


References 

Ailey. A (2U01 ). Essay. s from contemporary culture (4th ed.j. 


Heinle y Heinle/ 


Beeghly. D. (2005). It's about time. Using electronic literature discu&non groups with adult 
learners (Electronic version) Journal of Adolescent & Adult LtUmy. 49(1), 23-30. 
lu*. roller, C., y Srardamalu, XL (1999). Intentional learning as a goal of instruction In 
L B Re snick ( Ld ). /Cnou-tng learning, and mstmenem (pp. 381-392) Hillsdale, NJ: 


Boylan, H (2002> What Vvbrks Research Rased Practices m Daehpmenral Educanon Boone, 
SC: Continuous Quality Improvement Nctwark/Na&anal Center foe Developmental 
Education, Appalachian State University. 

Burgess, 11 L. (2X0 8). (Journal entry in devekipmrntal studies classroom]. Unpublished 
raw data. 

Burgess, 11 L. (201 17). (Journal entry in developmental studies classroom]. Unpublished 


Caverfy, D. C.. Nicholson, S. A, y Kadcllffe, A (2004). The effectiveness of strategic 
reading instruction for college developmental readers. Journal of C'oftrge Reading and 
teaming, 35(1). 25-46. 

Caverfy, D. C., 6r Peterson. C. (2005). ft eh talk. Building academic literacy through on- 
line discu&sxm forums (Electronic version). Journal of Developmental Education, 29(2), 


Conrad, A, y iXmaldaon, J. (2004). Engaging the onkne learner San Francisco. Joiaey- 


Car, S. R., Fnexne* D . & Rhayum, M. (2053). Do reading skills courses help underpeepared 
readers achieve academic success in college? Jcurruil of College Reading and Learning, 
33(2), 17M96. 

Eric a, T (2003) The Use of Char m EPL/EAL. Retrieved January 3, 2007 from Berkeley 
University, TH5h HI leaching English as a Second or Foreign Language Web site, 
mni' uTtm\g bcrVelesj edit 

Lble, A (1994). Crnjt of teaching A guide to mastering the professors an (2nd edition), 

New York. Jossey-Baas 

Bidet L . y Paul. A (2004). Critical thinking, and the art of close reading part IV Journal 
ofDceJcpmentaJ Education, 26(2), pp. 3M7. 

llippn, A T (2001 ). Reading researchers m search of common ground Newark. D£. Inter- 
national Reading Association. 

r rrdr.nouon. A, P*iett, A. fr Shea, P. (2000). Student satis acti o n and perceived learn- 
ing with an line courses Principles and examples from the SUNY Learning Network 
(Electronic venxm). Journal of Asynchronous leaning SetuorVs, 4(2 y 


U&ng 1 YebCT as a auppi&n&ual tool 


31 


Pty, V, fr Haling, A. (1998). Virus ard processes for integrating rending ard writing far suc- 
cessful Ari'e.liTpiKernl practice. (Electronic reman). Removed December 11, 2007, fro m 
http //bw rude net /documents / Monc96/mcmcM 4 pdf. 

Gambrell, L (2 tW). Technology and the engaged literacy learner In M.C. MciCenna, L.D 
lahbo, R.D Kieffe* & D. Re inking (Eds X tntcmancmal handbook ofhteracy and tochnol 
*®r(pp. 211*294). Mahweh, NJ Eribaum. 

GomhanvC^Kaleea, R.(2<W2) lntrodixnnn tn Hytnd Courses Ttachmgurfk techmk#ttedty, 
fl(lOX Retrieved June 18. 2008, from ktrp //tnru* uuva edu/ttt/arnclee/gamham htnt 

Haseelhring, T Lott, A. C., Zydney, J. M. (2004). A renew o i technology based 


Washington DC. Amman Institutes for Research 

Hidi, S, & Anderson, V. (1992). &tuatx>ml interest and ns impact an reading and expository 
writing In RLA. Renmngei; $. Hidt, & A Kiapp ( Ldi ). 7he role of mtemst in burning and 
dci<!>T r mcnt {pp. *28). Hillsdale, NJ Erfbauro. 

Johnston, J, Billion, Oomen, J. (2008). &ixlr.nt sataifactxm in the virtual claisrcoro 7he 
Internet fcicmal of AiTiol Health Sciences ard Practice. 3 Removed January 28, 2008, 1 
http //xjahsp nm,ucdu/amieA/ivtenxun2/}ohnston%20%20Pnnicr%20\ < evsum pdf 

Krech. t (2001 ). Developing writers using technology 2001 A Uci'dopmeni 
(Monograph } Warrensburg, MO. NADU. 

Larin, D. t & Hyllegard, D. (1996 ). Cho7Vgir^ the odds Open admissions and the hfe changes 
of the cbsadi ant aged | Electronic Tension). New Haven, CT Yale University Press. 

Lee, K. (20U7X Onhne collaborative case study learning Journal of College Reading and 
learning. 37(2), 82*1(0. 

leu, D J., hmrrr C. 8L, Colro, J. L., Sr Commack. D. W. (2004). Tbward a theory of new 
literacies emerging from the Internet and other information and communication 
technologies In R.B Ruddell N J. Unrou (Eds.), 7Tr corneal Models and Processes m 
Reading (pp. 1570-1607) Newark DE. Internationa] Reading Association 

Ley. K., & Young. D. 8. (1998) Motivatxm xn developmental and regular admission college 
students. Research and teaching m Da'elopmertal Education 14(2), 29-39. 

Lindsey- North J. L (20X) tna-xporanng a ccsast uebrztc into teaching A promising practice 
cspeczauy for teacher education. (Report no SP039547). Place of jxib. Wnght State 
University (ERIC Document Reproduction Service No. LD447W77). 

Lowery, Yeung. D. 8. (1992). Designing motivational m«mnt»n for developmental 

education. Research and teaching tn Dei'cioymcnuri Education. 9(1 X 29-44. 

Martyn, M. (20Q3). The hybrd onhne model. Good practice | Lie ctronic version). Editions? 
l&artcriy. i, 18-23. 

Mctabc. R. H, tr Day, P- R, Jr (1998). De\<lopmentai education A tuenty first century social 
and economic unperatzi'c Mission Viejo, CA League for Innovation tn the Community 
College. The College Board 

Moore, R (2AU7). Academic motivaQon and performance of developmental education 
biology students, journal Of DnehpmcrLtal Educatim. 2J(1), 24-34. 


Journal if CoUege Raiding and Learning 39 (2% Spring 2009 


32 


NADE. (2007) Defintixm of developmental education. Retrieved January 31. 2008. from 
http //ituw node net 

National Center for Educational Statistics (NCDE) (20U3J Remedial education tt higher 
msnnitxcm m /off 2fiC0 (Report No. NCES 97-6A4) Washington D.C : NCDE 
Onwuegbuzie, A J., fr Darnel, L. G. (2002). Uses and miiiae* of the correlation coefficient 
Research w the Schools, 9(1). 7390. 


Osterman, P. P. (2005). A comparison of student performance m developmental reading 
us in g tradmonal versus a hybrid model of traditional and online instruction. Research 
m Dexelopmental Education. J9(2) 14. 

Paliof. R, y Pratt, X. (2003). 7be nmioJ student A profSe andgicde to uyrrkng uth online 
Jeamcrn San Francisco. CA Jersey Bass Publishers 

Penn, D. (2005). Institutional dedsion making for increasing academic preparedness in 
community colleges. Sew Dirtcnon far Community Colleges. 129. 27-30. 

Perkins, C.. // Murphy, E. (2000). Identifying and measuring individual engagement in 
f ntirjl thinking in online isscuisnna An exploratory case study ^iiuatuvul Torhncf 
cgy&Soocty. 9(1), 298-307. 

Petndes, L., Kerglam, A., y Nguyen. L. (2006) Basic Online Education Literature. 
League .tor the lmoi'aton tn Community College Retrieved on December 12, 2077. from 
http //wuu' league. c*g/Vague/pm-c,ect&jl>co/ fie*/ Literature Jyexncw pdf 

Pintndi, PR-.fr Garda, T (1994) Self- Regulated learning m coliege students Knowledge, 
strategies and motivation. In P. R Pintnch fr D. R Brown (Eds.). Student m.nwOOT. 
cogmtan and leaning E*eayt in hone* of Wilbur /. McKeacrze (pp.113-133). H i llsdale, 
NJ Erihaum 


Quxtadamo, 1. J, fr Drowtx A (2001). Effective teaching styles and instructional design 
foe online learning environments. Sanonal Eiuroncvisi Computing Conference Chicago, 
1L. 

Richmond. V. (190)). Communication m the da&trcom |Eloctromc version) Commumca 
ton Education. 29, 183-190. 

Roberson. T., fr Klotz. J (20)1, November) Char 7Tie missing hnk tn on line instruction 
Paper presented at the Annual Meeting of the Mad-South Educational Research As- 
sociation. Little Rock. AR 

Saxon. D. . fr Boylan, H (2034). Characteristics of Community College Remedial Students 
Prom http//wwwncck appstate edu/ 

Scxiven, M , fr Paul, R (2004, Month day). Defining critical thinkmg. Retrieved January 28, 
2006, from http //uuu cmcahkinXing orgj 

Smith G., Ferguson. D.. fr Cana, M (2001) Teaching college courses online vs. fiic«seo- 
fricc TliE Journal, 2fr v 9) 11328. 

Ihsta, A (200)) Seven pnndples for good practxe m teaching and technak^r. In R A Cole 
(Ed.), Issues in l Vek Based pedagogy (pp. 238-243). Waitport. CT. Greenwood Pnni. 

Texas State Data Center and Office of the State Demographer (2018. June 19) Than 
population estimates program., San Antonio. TX. Texas State Data Center and 


Using WebCT to a supplemental tool 


33 


Penearch. the Utuvemty of IUai at San Antonio Retrieved Jane 19, 2000, from 
htrp //nxk. u iia cdu/xpepp/vqxpeaphp 

Hi, C H, y Cony, M. (20113). Designs management tactics and atrategieA m asvnehmnoai 
learning (iucuiiotr.nl (Oectronir- retrain). The Quarto'll Bei'iac of Durance Education, 
4(3X 30W1S 

Wadsworth. L. (21107) Online mathematics achievement. lifrcto of learning strategic* 
and «elf-efficacy founud of Daekptnenal education, 30(3), 6-14. 

Wiggins <!.. y McTigbe, J. (200S, Month). Understanding by deagn 2nd ed Aloandna, 
VA Asiixuatun for Stiperriuon and Cumuihim Developnienl 


Mellaa Burgess. M Ed, tea Literacy Sf/ectahst and doctoral student tn the College 
of Education in the Language. Literacy and Special Populations department at Sam 
Houston State University She received her BA tn English and M Ed tn Curriculum 
and Instruction from the University of Missoun-Colunthui She teaches developmental 
reading and reading and irnftng in the content area courses. Current research 
interests include instructional technology, optimal experience tn Mrfua/ u Drills and 
online learning’ fir college reading students. Meluaa can be contacted by e-mail at 
mbu!gew2004(Sy ahoo. com. Her postal address te 259 Genesee Bulge Court, Conroe, 
TX 77385. 


